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Let \X(t)} be a continuous-time, continuous-in-the-mean, real, strictly stationary 
random process. If x is a given number, denote by Vt{%) the proportion of the time X(t) 
exceeds x, 0<t<T. The covariance of pt{%i) and prte) is obtained. An approximate 
solution for the variance of a sample quantile is also given. The general results are special- 
ized for Gaussian and x 2 processes. 

1. Introduction 

The proportion-of-time distribution plays a very important role in the statistical analysis 
of time series data. The practice is to plot p(x), the proportion of the time the record, X(t) } 
exceeds x, against x [e.g., 1,2] ^ \n general, if X(t) is a wide-sense stationary process and a 
sample over O^t^Tis available, an estimate, Pt(%), of the probability that X(t) ^ x is obtained 
from the sample. \n this paper we will derive the covariance of p T (%i) and p T (:x?)- An ap- 
proximate solution for the variance of a sample quantile will also be given. The general results 
will be specialized for Gaussian and x 2 processes. The Rayleigh process is a special case of the 
X 2 process; however, due to its wide applications, the result for this particular case will also be 
stated. 

2. Some Properties of Time Averages 

Let {X l (t),X 2 (t)}, teli {1) , be a wide-sense stationary, real, continuous-parameter, con- 
tinuous-in-the-mean, vector process, t will be called time and 7i (1) will be taken to be a real 
line. 

For i=l, 2. and for all t and 6', let 

EX i (t)=m i) -\ 

EX i (t)X i (t+s)-m 2 i =R i (s) J I (2.1) 

EX 1 (t)X 2 (t + s)-m l m 2 = R l2 (s), J 

where EX denotes the mathematical expectation of the random variable X. It will be assumed 
that all quantities in (2.1) are finite. 

When statements are made which apply to either of the processes, or when the properties 
of a single process are considered, the process will be referred to as {X(t)}< and the subscripts 
will be omitted, e.g., EX(t) = m, EX(t)X(t+s)-m 2 =R(s). 

Let J 7 be a positive number, N a positive integer, d=T/N, and denote X t {kd) by X t (k), 
R t (kd) by Ei(k), etc., since there will be little danger of confusion. {X x {k), X 2 (k)} , k = 0, 
±1, ±2, . . . , is, then, a wide-sense stationary, real, discrete-parameter, vector process. 

We may consider the discrete-time process and extend the results to the continuous-time 
process by taking the limit as A^o°, I 7 fixed; or, we may consider the continuous-time process 
and obtain results for the discrete-time process by replacing integrals by appropriate summa- 
tions. In general, we will pursue the latter procedure. 



i Figures in brackets indicate the literature references at the end of this paper. 
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Let t h t 2 be arbitrary numbers, and T u T 2 arbitrary positive numbers. Define 

X iT (t t ) =-~ f ' Ti X t {t) dt, i= 1 ,2. (2.2) 

It will be assumed that the subscripts on X are so chosen that T 2 ^ T x . 
For the discrete-time case, we take k h k 2 arbitrary integers; JVi, N 2 arbitrary positive in- 
tegers, choosing the subscripts on X so that N 2 ^Ni; and define 

X Wi (k t )^r A S Xtf), 4=1,2. (2.20 

Now 

EX iTi {U)=m u i=l,2, (2.3) 

and 

J i y i * y^» ryi -L / 

*1 *J t 2 

^(T^y 1 ( Tl+h r 2+l2 R l2 (t-t')dtdt'. (2.4) 

J tl J t 2 

The interchange of operations of expectation and integration in (2.3) and (2.4) is justified 
us EX 2 i(t)< oo , i=l,2. 

We now make the transformation u=t — t f , v=t'. The Jacobian of the transformation is 
unity. The limits of u and v are given by 

U-h-T^u^U-U + T,, 

max {U, t 2 —u)^vt^ min (7\ + £i, T 2 J rt 2 —u). 

Hence (2.4) becomes 



where s=t 2 — 1\. Now 



(TiTo)" 1 f ? ' [min(7 7 i+^i,? 7 2+^--^)---niax^ 1 ,f 2 -^)] J Bi 2 (^)^, 

fri-r-^when^^^+Ts-T! 



r 

\T,- 



min (Ti + ^i, T^U—u)- 

2 J rt 2 —u i otherwise; 



,. N f ^—^, when w^s, , . 

max (^1,^2— w) = J . (2.5) 

^ £i, otherwise. 

Replacing ^ by £, we obtain, for arbitrary t and s, 

{X lT (t) ) X 2T (t+s)} = (T l T 2 )~ l [ (° (T 1 -s+u)R 12 (u)du+T 1 ( T2 ~' " R 12 (u)du 

LJ-Tj+s Js 

+ f T,+ * (T 2 +s-u)R u (u)du~\- (2.6) 
JT,-r,+i J 

Remark 1. Setting A r 1 («)=Z ! (f)=J?(0 in (2.6), we obtain 



COT 



{X Tl (0, X r2 «+s)} = (r 1 T 2 )- 1 [ P {Tt-8+u)B(u)du 

+ T 1 ( T2 ~ T,+S R(u)du+( 2 (T 2 +s-u)R(u)du~}> (2.7) 
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Remark®. If T 1 =T 7 =T 1 

cov {X T (t), X T (t+s)} = T~ 2 [ I S (T-s+u)R(u)du+ J ' h ' (T+s-u)R(u)dul (2.8) 
Remark 3. Setting s = in (2.8), wc have 

V8iTX T (t)=T- 1 f T (i-M\R( u )du. (2.9) 

From (2.3) to (2.9) we deduce that, for fixed T, and T 2 , {X 1Tl (t), X 2Ti (t)} is a wide-sense 
stationary continuous-time and continuous-in-the-mean process. 

For the discrete-time case, we will state only the results corresponding to (2.6) and (2.9). 
When translating a sum of integrals, such as 

r+r 

J a J b 

into a Riemann sum, we should be careful to note 4 that, whereas b appears twice in the limits 
of the integrals, the corresponding quant it y will appear only once in the sum of two summations. 
Thus, for arbitrary integers k and s, 

cov {X Wl (k), X 2y (k+s)} = (N l X 2 )- 1 [ it (Ni-8+u)Ri*{u) 

N 2 -Ni+8 A T 2 +«-l "1 

+ 2 N 1 R 12 (u)+ 2 (N 2 +s-u)R l2 (u) • (2.60 

u=s+l w=A r 2— A^i+s+l _| 

Similarly, 

varr^)=^+ ; |s(l-^)i?W. (2-90 

The results (2.9) and (2.9') are well known [3, p. 80]. 

3. Empirical Distribution Function 

It will be assumed further that {X(t)} is a strictly stationary process so thai the probability 
distribution of X(t x -\-h) } . . ., X(t n +h) is the same as that of X(U), . . ., X(t n ) for every 
selection of n, t h . . ., t n , and h. 

Define 

V(t;x)=\ (3.1) 

0, otherwise. 



Then 



Pr(x)=7p f p(t;x)dt (3.2) 



is the proportion of the time x is exceeded by X(t) in the time interval (0, T), i.e., Tp T (x) is the 
Lebesgue measure of the set S x ={t :X(t)^x, O^i^T}. We note the following: 

(1) p(t; — 00 ) = 1 for all t; hence Pt(— °° ) = 1 ; 

(2) p(t; + °°) = for all t; hence p T (+™) = 0; 

(3) If x 2 >x 1} then X(t) ^x 2 implies X(t) ^x x . 

S X2 is, therefore, a subset of S x , and hence 

Pt(% 2 )^Pt(%i). 
Properties (1) to (3) imply that y T (x) = l— p T {%) is a distribution function. q T (%) will be called 
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the empirical univariate distribution junction of the process {X(t)}. We will, however, consider 
Pt(x) rather than a T {x). 

Suppressing x from pit, x~) for the time being, we have 

Prb(« 1 +A)=l p(t k +h) = l, p(t k+l +h)=0, ..., p(t n +h)=0] 

=Vv[X{h+h)^x, . .., X(t,+h)^x, X(t k +i+h)<x, . .., X(t tt +h)<x] 

=Vr[X(t 1 )±x,..., X{t k )^x, X(t k+1 )<x,..., X(t n )<x] 

=-Pr[p(h) = l,..., p(t k ) = \, p(t k+ i)=0, ..., p(t n )=0], (3.3) 

for every selection of k, n, t t t k , . . . , t„, and h. Hence, for a given x, {p(t; x)} is a 

strictly stationary binomial random process. In fact, it can be shown that, for a given set of 

values^], . . . , x m , {p(t; Xi), . . . , p(t; x m )} is a strictly stationary vector process. 
Writing 



we have 



P(x)=~PT(X(t)^x), 

Ef(t;x)=P(x), r=l,2, ..., 
vex p(t; x)=P(x)[l—P(x)], 

A(s; a;)=cov {p(t; x),p(t+s; x)} 

=Fr{X(0)^x, X(s)^x}-P i (x). ^ 



(3.4) 



(3.5) 



Let x 2 ^Xi] then 



A(s; x 1} x 2 )=cov {p(t; Xi),p(t+s; x 2 )} 

=Ep(t) Xi)p(t + 8] x 2 )-P(x 1 )P(x 2 ) 
=Pr{X(t)^x h X(t+s)^x 2 }-P(x 1 )P(x 2 ) 
=Pr{X(0) ^ x h X(s) ^ x 2 }-P(x l )P(x 2 ) . 
We note the following: 

Ep T (x)=P(x) 
A(s; x, x)=A(s; x), 
A(0; x h x 2 )=P(x 2 )[l-P(x 1 )]. 
Using (2.6) with 5=0, Ti=T 2 =T y we have 

C(xi, z 2 )=cov {p T ( Xl ),p T (x 2 )}=^ I (l—^)A(s) xi, x 2 )ds, 

C(x, x)=-Y2ivp T {x)=~ J (\—tjAA{s\ x)ds. 
For the discrete-time case, 

N 

p N (x) = N~ 1 ^2p(k)x), 



(3.6) 



Y (3.7) 



k=l 



N-l 



cov {p N (x 1 ),p N (x 2 )} = N- 1 P(x 2 )[l-P(x 1 )] + 2N- 1 S (l-slN)A(s', Xl ,x 2 ), 

8=1 

vsly p N (x) = N- 1 P(x)[l-P(x)]+2N- 1 2 (l-8/N)A(8; x). 

8=1 
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(3.7 7 ) 



To estimate A(s; x h x 2 ) and A(s; x), define 

1^0 otherwise; 

and use 

I nr-s 

P T (s; x h x 2 )=7p— p(t, t+s; x h x 2 )dt 

1 s Jo 

to estimate Fr{X(t) ^x u X(t+s) ^x 2 }. 

4. Variance of a Quantile 

Given x, p T (%) is a random variable. In the preceding section we obtained the variance of 
Pt(%), and the covariance of Pt(%i) and p T (x 2 ). In this section we will obtain an approximation 
to the variance of a quantile of the empirical distribution function. We suppose that a number 
q, 0<^q<^ 1, is specified. If U denotes the number such that 

p T (U)=q, (4.i) 

then U is a random variable. Let £ be the number such that 

r(i) = q, (4.2) 

i. e., £ is the qth quantile of the univariate distribution function of the process [X(£)]. 

In what follows the primes will denote differentiation with respect to the indicated argu- 
ment. Furthermore, it will be assumed that P(£) and p T (£) have derivatives. 

Now 

where = means " approximately equal to;" hence, 

P t(0-P^) = -(U-^)pt(0; (4.3) 

0*-E<p-Q\p'r(Q-P , m-P'(&E<P-&. 
Now 

therefore 

cov(U,p' T (0 = -P'tt)E(U-0. 
As a first approximation we suppose that 

EU=l (4.4) 

so that 

cov(^i.(€))=0. (4.5) 

As a further approximation suppose that U and p T {i) are independent. Writing 5y=y—Ey > 
where y is a random variable, we have 

82>r(*)*-l£G)«7, 

var p T (£)±vsirUEp' T 2 (£). (4.6) 

Now 
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h,k->0\ h / \ K 



= Elim(hk)- 1 [8p T (!;+h)-5p r (!i)+P(!i+h)-P(mPT(Z+k)-5p T (Z)+P(Si+k)-Pm 
=P' 2 (£) + lim (Afc)-i[0({+A f€ +fc)-Cft+A,f)-C7ft,€+fc)+Cft,J)] 






var Z7 



*[>»({)- 



wfe,y 



&&&& 



*»=&=« 



varprft), 



(4.7) 



and var ^ r (^) is given by (3.7). The result (4.7) assumes the existence of various derivatives 
appearing in the equation. In applying this result it is necessary to look into various approxi- 
mating assumptions which are used in arriving at (4.7). The approximation (4.5) seems fairly 
reasonable; but the assumption of independence of U and p T (^) needs careful examination 
in each individual case. 



From (3.7) 

d 2 C(xuX 2 )__l d 2 



U:.H)^**>*-*£0-^§8i?* <«> 



dxfix-2 TdxibfyJ-rV yy~\w,«<i, -*/- TJ- T \~ TJ dx^x 2 
in case the interchange of the integration and the partial differentiation is justified. If 

b 2 A 



/." 



\dxibx 2 



X l =X 2 = £ 



cfe< °°, 



then 



and therefore 



b*C 



bx 1 dx 2 



•^l - %2~ s 



=o(i> 



var Z7= varp r (f J/P'^tl+OCT- 1 )] 

5. Applications 
5.1. Gaussian Process 

If {X(t) } is Gaussian, write 

R(0)=a 2 Y(t) = [X(t)-m]/<r p(t)=R(t)/o*. 
It is known [4, pp. 355-6] that 



(4.9) 



=P(»+SP^)^^ 



i/i + v\ 

2 



;=i 



Here 



=P(» 1 )P(y 2 ) + Sp i Wr,(2/i)r,(7y 2 ). 






(5.1) 
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II r {x) is the Hermite polynomial of degree r given by 

H r (x)=e* 2 iH-d/dxye-*V2=x r - T lj^p- x r - 2 +^ ''~ 1)( ''~? )(r ~ 3) x"*- 



2 2 2! 



and 



T r (x)-- 



ff r -i(aQ e" x /2 
= (27r) 1/2 (r!) 1/2 



is known as the tetrachoric function of order r, and its tables are available [5] 

Thus 

4(^)=|p'(«)r)("). 
Inserting these values in (3.7), we have, since p( — s) = p(s), 

(7(a, * 2 )=f J^WD g p*(«)r, (^) r, (^) «fo, 
C(X, X) =| J^(l -8/T) ± p'(«)rj (") *. 
5.2. Variance of a Quantile 



(5.2) 



(5.3) 



Note that: 



(JTj(x) _ 

dx 



-.(2T)-^Hj\)-^dldx[e-^Hj.M} = -(J+iy /2 rj +l (x). 



Differentiating the first equation in (5.3) with respect to x x and x 2 , we get the formal 
expression 



^k-^=^j\ls/T)± OWW rj„(^) & . (5.4) 



_d 2 <7 



If the integral converges, we can evaluate it, and using (4.7) obtain the variance of the sample 
quantile U. 

A special case. Iix=m, 



vnrp T (m)=2T- 1 ( (l-s/T) 2 p'(«) ?* (0) cfo. 

Jo J=l 



Now 



i-«(0)=0, i=l,2,..., 
(-l)'(2j)! 



r 2 ;+i(0) = 



Hence 



varp r (m)=-~2 



(2T)» 2 2'(i!){(2i+l)!}'/ 2 
(2i)! 



» i=o,i,... . 



^T^o'2"(i!) 2 (2i+l) 
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Jo (1_S/T) 



P W+1 (s) ds. 



(5.5) 



If ?7is the sample median, then £ = m, and 
£> 2 , 



= (7r<r 2 T)- 1 ( T (l-s/T)[{l- P Hs)}- 1 ' i -l]ds. (5.6) 



in case the integral converges. We note that, for large value of j 



(2j)l 1 

^(JO^Grj) 1 ' 2 ' 



Hence the series (5.5) will always converge. A sufficient condition for the convergence of the 
integral in (5.6) is that 

Urns' {l-p 2 (s)}- 1/2 

exists for some 6,0\6<C 1. If the limit is nonzero for some b> 1 then the integral diverges. 
Example 1. If p(s) = P (— s) = e- Xs ,\>0,s^0, 

f* (l-sme-^ds^^j^+OiT-^n, j=h % . . . . 



Therefore 



Also 



varpr(m) xXr g 2 2 >(j!) 2 (2i+l) 2 t\ 2 T 2 § 2 2 '(j!) 2 (2j+l) 3+ ° (T ^ ^ 

= 0.35/(xr)-0.33/(XT) 2 +O(r- 1 6- xr ). 

b 2 C 



d^id^ 2 



Xi=:ro = ra 



_^__ - (2j)l l_ y^ ( 2 i) ! + Qfr-i e -xn 

\w<T*Tpi 2"(j!)*(2i) ttXVT 2 J=f 2«0"!)*(2j)*^ u ; 

Zn2 0.17 



0(r-V»). 



ttX(7 2 T ttXVT 2 
Hence, if c7 is the sample median, 

7-7 r 1 J Zn2 °- 17 l" 1 i \ 

. . . . r . 2/7i2 0.34-1- 1 

= 27r(T 2 varp r (m) l+-^p — ^5 • 

_ii 
Example 2. If p(s) = e 2a ' ', a similar calculation shows that 



var^ r (m) = 0.47a/r-0.35a 2 /T 2 +O 



(r-'e **). 



The integral (5.6) does not converge and we fail in evaluating the variance of the sample 
median by this method. In fact, an examination of the assumptions leading to the equation 
(4.7) shows that, in this case, Ep^i^) does not exist so that Pt(£) is not differentiable. 

Example 3. Let p(s) = cos (ws/k). Instead of using (5.5) to evaluate var pr(m), we 
proceed somewhat differently. Note that [6, p. 290] 

Pr [Y(t)^Q, Y(t+s)^Q}=l-~ cos -1 p(«), O^cos" 1 p(s)^w. 

Z Zt 
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Hence 



Now 



var 



Pr(wi)=2jT I (l— yLjds— ^y I U— |; j cos ' p{s)ds. 



cos V (s) = i 



g («-#*), i(2jk^s<(2j+l)k, j=0,l,..., 



k 



(s-2jk), if (2j-l)k^s<2jk, j=l,2,... 



LetT=lk+T u 1^0, O^T^k. We have 

■2, r (m)=i+g I~^f£_ T (l-j) COS-VW&, 



var 



where 



1 f 2 ^* / s*\ & it 2 7& 2 

Thus, after some simplification, we obtain 

\2T 2 \ — Y) ' 
^(^-3^+^) if /is odd. 



var p T (m)= « 



Obviously var p T (m) = whenever Ti = 0, / even, i.e., whenever J 7 is a multiple of 2&, the period 
of the process, and also var p T (m)->0 as T-^co . 



5.3. x 2 Process 

Let (X z (£)}, i=l, 2, . . ., n, be independent stationary Gaussian processes with the same 
variance, a 2 , and the same autocorrelation function 



Define 



p(8) = [EX i (t)X i (t+8)-mi]/a 2 . 



Y(t)=^<r-'{X i (t)-m i } 2 . 



{ F(£) } will be called a x 2 process as the univariate distribution of Y(t) is a x 2 distribution with n 
degrees of freedom which has the density function 

g(z; n/2) = [2 n/2 T(n/2)]- 1 e- z/2 z n/2 - 1 , for 2>0, 

= otherwise. 

It is easy to verify that { Y(t)} is strictly stationary. 
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The characteristic function, <j>(u,v) } of [Y(t),Y(t-\-s)] is easily evaluated to be 

<t>(u, v )=Ee iuY(t)+ivY{t+s) 

= [l-2iu-2iv-4uv(l-p 2 (s))]- n/2 

= (l — 2iu)- n/2 (l — 2iv)~ n/2 II -I 4p ^ Uv I 

v i ziu) [i M) L (l-2^)(l-2uOJ 

(-l) j r(n/2+j) {2p{s)} 2j uW 



=S 



pi r(n/2)r(j+l) (l-2iu) n/2+j (l-2iv) 



,*,,W2+r 



(5.7) 



as 



4:11V 



(l—2iu){l—2iv) 



4\vv\ 



[(l + 4i/ 2 )(l+4^ 2 )] 1 / 



,,2^1 1/2^-*-' 



the binomial expansion is uniformly convergent. 

For a full discussion of the distribution of [Y(t), Y(t-\-s)] the reader is referred to [7]. A 
technique of obtaining the probability density function of [Y(t),Y(t-\-s)] will be presented here, 
which is also applicable to other distributions which can be expanded in a series of orthogonal 
polynomials. 

Note the following: 



(i) 



I /*o° e -iUZ 



- j0 ( Z ;n/2)=-j_^ {l _ 2iu)nl2 du, 



(2) It is easy to verify from the definition of Laguerre polynomials [8, Ch. 5] that, for a>0, 

^■:.Nfe.- / ( ' ,+ ir' 1 g-»- 



dz } 



2 j T(a) 



] (z/2), 



where 



i] a, (3) = S(-l)' 



C- + 



/,!' 



is the generalized Laguerre polynomial of degree j. 

Hence, if n^2 — n=l may be reduced to the Gaussian case discussed in 5.1 — •, by the 
inversion of (5.7). the probability density function, g(z u z.,; n/2), of [Y(t),Y(t-\-s)] is given by 



g(z h z 2 ;n/2)=J^ 



[2p(s)]»T(n/2+j) d 1 



. N d> 



ft r(,/2)r(i+l) M 9^,nl2+j) M9 {z 2 ;nl2+^ 
T(j+l)T(n/2) 



=g(z i; n/2)g(z 2 ;n/2)^ T{n/2+j) 



P »(s)L?" i -»(z 1 /2)L}« l2 - ll (z 2 /2). 



(5.8) 



Now, using the first equation in (5.8), Ave obtain 
TT{Y(t)^y h Y(t+s)^y 2 }= P f" g( 2l ; z 2 ;n/2) dz 2 dz x 

JVi JH 



t>< nd/ , , ^[2p(s)} 2i r(nl2+j) d J -* , /0 , ~ d j -* , /0 . .. 
=P(y,)P(ifa) + g T( ni2)r(Ul) dyr Myi]n/2+j) dW MW ' n ' M ' j) 



--P(yi)P(y 2 )+g(yi;n/2+l)g(y 2 ;n/2+l) g 
L[ n J?(yi/2)L?L<?(y 2 l2), 



2nT(j)T(n/2+l)p i} {s) 
jT(n/2+j) 



(5.9) 
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where 

P(y)= (" g(z; n/2)dz. (5.10) 

Jy 

From (3.6) and (5.9), the covariance of p(t;yi) and ^(^+ s; y 2 ), 

A(s;y 1 ,y 2 ) = g(y 1 ;n/2+l)g(y 2 ;n/2+l) g ^^^l)^^ W <JfiP)L}»?<yj2). 

Inserting this value in (3.7), we obtain an expression for the covariance of Prilh) and 
Vt{V2)- The variance is given by setting y 1 =y 2 =y. 

A special case, n=2 gives a x 2 process with two degrees of freedom, i.e., the Rayleigh 
process. We find 

cov { P T(yi),PT(y2)}=^g(yi;2)g(y 2 ;2) p^LJUyimL^iy^)^ (l-f) p^(s)ds. (5.11) 



The author thanks Dr. E. L. Crow for his helpful discussions during the preparation of 
this paper. 
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